Apache OpenNLP is a machine learning based toolkit for the processing of natural language text.

After looking at a lot of Java/JVM based NLP libraries listed on Awesome AI/ML/DL I decided to pick the Apache OpenNLP library. One of the reasons comes from the fact another developer (who had a look at it previously) recommended it. Besides, it's an Apache project, they have been great supporters of F/OSS Java projects for the last two decades or so (see Wikipedia). It also goes without saying that Apache OpenNLP is backed by the Apache 2.0 license. In my current research project, I experimented with @ApacheOpennlp and was delighed to see it's a valuable NLP toolkit with a user-friendly API.

Introduction Some time ago I came across this life-cycle management tool (or cloud service) called Valohai and I was quite impressed by its user-interface and simplicity of design and layout. I had a good chat about the service at that time with one of the members of Valohai and was given a demo. Previous to that I had written a simple pipeline using GNU Parallel, JavaScript, Python and Bash - and another one purely using GNU Parallel, and Bash. I also thought about replacing the moving parts with ready-to-use task/workflow management tools like Jenkins X, Jenkins Pipeline, Concourse or Airflow but due to various reasons I did not proceed with the idea.

This week, data is becoming knowledge as all streams of data are converging and leading me to the conclusion that every business is in need of the same types of data, tools, and results. From payment processing to media to rentals to retail to finance to big pharma, the same problems are coming up of "How do I ingest all kinds of data (variety), constantly changing (agile), often broken (flexible, schemaless or schema flexible), do some transformations in stream and land it in my big data environment (Hadoop with some flavors of NoSQL or data warehouse (SAP HANA or SQL Server or Oracle X) on the side)?" Oh and it's got to be fast, scalable, easy to use, and have a UI that can be used by my intern/data engineers. Some of the data is coming from IoT devices, cameras, beacons, web logs, Twitter, Facebook, 3rd party paid feeds, free feeds from NOAA, government and partner data sources, and legacy systems. So what can support text files, JSON, JMS, MQTT, REST, XML, MongoDB, S3 and a host of sources and formats?